What is Special about Diffusion on Scale-Free Nets? 
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We study diffusion (random walks) on recursive scale-free graphs, and contrast the results to 
similar studies in other analytically soluble media. This allows us to identify ways in which diffu- 
sion in scale-free graphs is special. Most notably, scale-free architecture results in a faster transit 
time between existing nodes, when the network grows in size; and walks emanating from the most 
connected nodes are recurrent, despite the network's infinite dimension. We also find that other 
attributes of the graph, besides its scale-free distribution, have a strong influence on the nature of 
diffusion. 



C/3 



I 

o 
o 



> 

o 
o 



o 
o 



X 
J3 



PACS numbers: 02.50.-r, 05.40.Fb, 05.60.-k, 89.75.Hc 



I. INTRODUCTION 

Recently there has been growing interest in large 
stochastic networks, such as social networks of contacts, 
networks of collaboration between scientists, the Inter- 
net, flight connections, networks of predator-prey, and 
many other examples in biology, sociology, economics, 
even linguistics nil Hi. While the inquiry into net- 
works begins already with Eiilcr's seminal work on Graph 
Theory, the latest interest stems from the discovery that 
many of the large networks encountered in everyday life 
seem to be scale-free P, Q : the distribution of the degree 
of the nodes (the number of links k coming out of a node) 
has a power-law tail. 



P{k) 



A: > L 



(1) 



The scale-free degree distribution is implicated in exotic 
properties of the networks, such as increased resilience to 
random failure (the nets maintain a connected backbone 
under random dilution of the nodes, when the degree 
exponent is 2 < A < 3) and increased vulnerability to 
removal of the most highly connected nodes . Indeed, 
it has been suggested that the need to attain such at- 
tributes might have acted, in some cases, as the natural 
selection mechanism giving rise to the scale-free distribu- 
tion in the first place. 

In this communication we examine whether there is 
anything special about transport by diffusion in scale- 
free nets. Diffusion is of course a very natural mode of 
transport, where hopping from one node to the next is 
unaffected by the history of the walk. (We think mainly 
of simple random walks, where the walker takes one time 
step to transit between adjacent nodes, and refer to these 
as diffusion.) Accordingly, diffusion on various networks 
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has been studied extensively 0, S H 0| We approach the 
question by comparing recursive scale- free nets to 
other nets. To make the comparison meaningful, we re- 
quire that the nets possess a well-defined average de gree , 
{k) < 00, in the thermodynamic limit of — > 00 |l2| . 
The recursive scale-free nets are studied for convenience, 
because they allow for exact analysis Our hope is 

that stochastic scale-free nets are well represented by the 
examples chosen, though to which extent they do remains 
an open question. We do find advantages to a scale-free 
architecture in the form of faster transit times between 
existing nodes, when the network grows in size. We also 
observe that walks emanating from the most connected 
nodes are recurrent, despite the networks' infinite dimen- 
sion. 

The rest of this paper is organized as follows. Diffu- 
sion and its effectiveness can be gauged in many differ- 
ent ways, and in Section^ we explain which aspects of 
diffusion we choose to focus on. As an example we exam- 
ine the complete graph, thereby introducing some basic 
techniques used later in the study of scale-free nets. In 
Section [fill we briefly survey how diffusion fares on other 
network architectures, including regular and fractal lat- 
tices. The main bulk of our results is given in Section llVl 
where we analyze two recursive scale-free nets, sharing 
the same degree distribution, but representing two ex- 
tremes in terms of the number of paths connecting any 
two nodes. Our conclusions are summarized in SectionlVl 
Technical details about the scale-free networks studied 
here, and the methods used for this purpose, are left to 
the appendices. 



II. MEASURES OF DIFFUSION 

Diffusion along networks can be characterized in many 
different ways, but we find it most convenient to focus 
on the following: 

• Mean transit time, Ty-: This is the mean first pas- 
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sage time (FPT) between two distinct nodes i and 
J, averaged over all node pairs. 

• Mean return time, Tu: This is the mean time for 
returning to a node i for the first time (after having 
left it), averaged over all the nodes of the net. 

• Scaling efficiency: How the various FPTs increase 
upon growth of the net. 

• Recurrence: Diffusion from a node is recurrent if a 
walker starting from the node returns to the node 
almost surely over the course of time. When dif- 
fusion is not recurrent, we call it transient. The 
concept is useful only in the limit N oo, since 
all nodes are recurrent when N < oo, regardless of 
the net's architecture. 

The mean transit time Tij is a measure of how fast one 
can navigate the net randomly, through diffusion. The 
mean return time Tu is a rough measure oi prominence: 
how easy it is to find your way back home. The average 
over all ij pairs of nodes (for Tij), or over all nodes i 
(for Tu) is necessary in order to obtain a single figure of 
merit representative of the graph as a whole. We omit 
the commonly used angular brackets denoting average, 
for brevity, whenever there is no risk of confusion. In 
situations where the graph is highly inhomogeneous the 
average conceals the wide distribution found when look- 
ing at individual nodes. We shall indeed examine this 
distribution for the notoriously inhomogeneous case of 
scale-free nets. 

A quantity related to the mean transit time is the mean 
sojourn time, the FPT from node i to node j and back: 
Tiji = Tij +Tji. While Tij is not necessarily equal to Tji 
for a specific pair of nodes, upon taking the average over 
all pairs one simply has (Tiji) = 2{Tij), so the mean so- 
journ time is trivially related to the mean transit time. It 
will be ignored in our study. Note that there is no simple 
relation between Tiji and Tu, and separate consideration 
of the latter is necessary. 

In all cases, the relevant question is how the FPT scales 
with the size of the net, N . Clearly, the various FPTs 
increase with TV, but we ask whether there is a preferred 
architecture that minimizes the increase. To tackle this 
issue, we introduce the concept of scaling efficiency. Sup- 
pose that the net grows in size, from N to bN nodes. We 
expect that in the thermodynamic limit of iV — s- cx) 



T,j{hN)^W^^T,j{N), 



(2) 

(An analo- 



defining the scaling efficiency exponent rjij. 
gous relation for Tu defines rju.) 

Scaling efficiency can be restricted to the nodes already 
present in the network before growth. Let Tij [bN] be the 
mean transit time in the augmented network, averaged 
over the original set of nodes (before growth). Then we 
define the restricted scaling efficiency exponent, Vij, thus: 



and similarly for Vu. Implicit in this definition is the 
assumption that growth occurs in a way that preserves 
the relevant attributes of the network (for example, the 
degree distribution). Suppose that the net in question 
is the Internet, and that Tij, representing the average 
number of links to be randomly followed to connect two 
users, is sampled at two different times. In that case Vij 
reflects the inconvenience in increased transit time asso- 
ciated with growth for old users, those that were there 
already at the first sampling, whereas rjij refers to all 
users, old and new. We shall see that for some scale-free 
architectures Vij < rjij . 

Finally, recurrence is a stricter measure of prominence 
than the mean return time. Indeed, a finite mean return 
time implies recurrence, but diffusion from a node might 
be recurrent despite having a diverging mean return time. 
We will show that recurrence in scale-free nets may vary 
from node to node, thus we shall deem a node recurrent 
(or transient) if diffusion from that particular node is 
recurrent (or transient). A simple way to decide whether 
a node is recurrent is to trap all walkers that return to the 
node and consider the survival probability of remaining 
walkers in the long time asymptotic limit: the node is 
recurrent if the survival probability tends to zero. 



Theoretical techniques and the Complete Graph 

We now demonstrate some basic theoretical techniques 
for analyzing FPT, as applied to complete graphs. In a 
complete graph of N nodes, K^r, all nodes are connected 
to one another (there are ^N{N — 1) links). The com- 
plete graphs is maximally connected and serves as 
a useful yardstick. Furthermore, the high symmetry of 
Kat simplifies its analysis and makes it a perfect start for 
pedagogical purposes. 

The mean transit time Ty satisfies the equation 



Ti'] 
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(4) 
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A walker starting off from node i faces N—1 equally likely 
choices (corresponding to the number of links emanating 
from i). Only one of the links would lead to node j 
directly, in one time step. This choice is represented by 
the first term on the rhs of Eq. Q). The second term 
represents a choice leading to a different node, h. This 
happens with probability (A^— 2)/(iV— 1), which accounts 
for the prefactor. It takes one time step to reach node 
h, and then, the walker is faced with an additional mean 
FPT Tfij, to reach the target j from node h. However, 
due to the fact that in the complete graph all nodes are 
equivalent, Thj is identical to Tj, enabling one to close 
the equation. Solving for Ty we obtain 

T,,{N) = N-1. (5) 

The mean return time is analyzed in similar fashion. 
It satisfies the simple equation 

Tu = l + Tj,. (6) 
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A walker starting off from i must step to one of the neigh- 
boring sites, j, taking one time step to do so. This ac- 
counts for the first term on the rhs of JHl- Once at j, the 
walker needs an additional time Tji for returning to i (sec- 
ond term). However, all sites being equivalent, Tji = Tij. 
Hence, 



Tu{N)^N. 



(7) 



Eqs. Q and © are particular instances of the underlying 
backward equation (known also as Dynkin's equation) |3, 
IT5I I , a general, powerful approach which is best learnt by 
example. See also Appendix IbI 

For the simple case of the complete graph we can do 
better than merely deriving the mean FPT; we can in 
fact obtain the whole distribution of first passage times. 
Let Fij{t) be the probability that the FPT from i to j is 
exactly t. It satisfies the equation 



1 



N - 1 



St, 



N -2 
N - 1 



(8) 



where St.i is a Kronecker delta- function. A walker gets 
from i to j in one time step with probability 1/{N — 1) 
(first term on rhs), or it gets first to some other site (sec- 
ond term). Getting to the other site takes one time step, 
so to conclude in t steps the walker needs to complete 
the trek in i — 1 steps. 

The recursion is best solved by means of the generating 
function 



t=0 



Operating on © with yields 



N-2 - , , 
X + — — -xF^ (x) 



N -\ N -\ 



F,,{x) = 



[N -I) - (N -2)x' 



(9) 



(10) 



(11) 



After Taylor-expanding Fij (x) , one can read off the prob- 
abilities directly: 



1 



N-2 



N-1 \N-1 



t=l,2,. 



(12) 



The distribution of mean transit times is a simple expo- 
nential, and it is easily verified that = tFij (t) — 
N — 1, in accord with our previous finding. It immedi- 
ately follows that the distribution of mean return times 
is exponential as well, 



F^,{t) = 



1 



N 



N-1 \N -1 



t-2 



i = 2,3,. 



(13) 



The exponential tail is a generic feature in all finite 
graphs (regardless of architecture). For t :s> Tij, one 



expects Fij{t) ~ exp(— at/Ty) (a is a constant of or- 
der unity), and similarly for Fait). Differences are to be 
found only in the early time regime, t < Tij. Note, how- 
ever that with TV — > 00 this "early" time regime can be 
arbitrarily large. 

We now turn to the question of recurrence on the com- 
plete graph. To this purpose, imagine an ensemble of 
walkers starting off from a node (the "origin" ) . The walk- 
ers get trapped whenever they return to the origin, and 
are taken out of circulation. Because all nodes, besides 
the origin, are equivalent, the probability for finding a 
walker in any of the nodes is equal. Denote the proba- 
bility for finding a walker in a node (besides the origin) 
at time t by St- Clearly, it satisfies 



St 



N-2 
N-1 



St, 



(14) 



for the walker leaves the node with probability one, but 
walkers from each of the N — 2 neighboring nodes (all but 
the origin) step into the site with a probability propor- 
tional to 1/(A^ "I)? and also proportional to the density 
of walkers in the neighboring sites, St- The solution is 



5** — Sq 



N-2 
N - 1 



(15) 



so we see that in the limit N —> 00 the survival proba- 
bility is constant: the walker never returns to the origin, 
and diffusion on the complete graph is transient. Note 
that to test for recurrence it is necessary to take the limit 
N ^ 00 before considering the long time asymptotic of 
t — > 00. 

Another easy way to see that the complete graph is 
transient, is from the distribution of FPTs. We see from 
Eq. (O that Fi,(t) ^ as N ^ 00, for any finite t. 
That is, as — > cxD the probability of returning to the 
origin at any finite time is zero |l6j |. 

With regards to scaling efficiency, the scaling of Tij 
and Tii with N implies that for the complete graph 



mj = 1, 



= 1. 



(16) 



Also, since all sites are equivalent, whether one averages 
over the preexisting nodes or all nodes does not make any 
difference in this case, and 



1, 



1. 



(17) 



In closing this section, we remind the reader that the 
complete graph is an extreme, ideal case of maximal con- 
nectivity. This ideal of connectivity comes at the cost of 
not being able to maintain (k) constant as N increases. 
To do that, most links — a fraction 1 — 0{1/N) — need 
to be removed. The question is whether one can whittle 
down the graph in such a way so as to improve the bench- 
marks of diffusion considered here. On the one hand, 
removing links increases the average distance between 
nodes, thus contributing to larger FPTs. On the other 
hand, judicious removal of links can help a walker focus 
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on following selected paths between the nodes, reducing 
the risk of getting lost in a plethora of roundabout paths. 
It is these two tendencies that must be balanced in de- 
signing efficient nets for transport by diffusion. 

III. DIFFUSION IN OTHER MEDIA 

Let us now review how diffusion fares in some of the 
better known media, besides scale-free nets. Our goal 
here is to try and understand how diffusion changes from 
one architecture to another, and why. 

Regular and fractal lattices 



The scaling in H21(l can be understood in the following 
way. When diffusion is recurrent, the typical time to 
transit between i and j is ^ r^". But the typical 
distance between two sites scales as r ~ TV^/'^f, and l|21|) 
follows. If diffusion is not recurrent, the target j will 
likely not be reached even after the walker's displacement 
equals r^. Instead we would typically wait until each 
site on the lattice is visited once, on average, before j 
is reached, and that would take as many steps as there 
are nodes in the lattice, or T ~ TV. Regular Euclidean 
lattices may be subsumed in this description of fractals, 
with d{ = d and = 2. Euclidean dimension d = 2 is a 
marginal case where — d{. Diffusion turns out to be 
recurrent in this case. 



Regular lattices are one simple way to scale the net in 
size while maintaining a constant (fc), since the degree of 
each node is fixed. Diffusion on regular lattices changes 
in character with dimensionality. The mean FPT scales 
as 



d= 1, 
d>2. 



(18) 



In the limit of oo, the distribution of FPTs (whether 
from a site to itself, or from a site to another at a finite 
distance), behaves as 



1/^3/2^ rf^l^ 

1/tlnt, d = 2, 
l/t''/2, d>3. 



(19) 



Note that in d — 1,2, the mean first passage time 
T = J tF{t) dt diverges, though diffusion is recurrent. 
In d > 3, the integral / Fit) dt < 1 and there is a fi- 
nite probability that the walker never returns to the ori- 
gin: diffusion is transient (and the mean FPT diverges 
as well). 

Consider now fractal lattices. It is possible to construct 
fractal lattices such that (k) is bounded. A well-known 
example is the Sierpinski gasket, where all nodes other 
than the three corners have degree fc = 4. Diffusion in 
fractals is anomalous and scales as 



(r^) r. t 



d„ > 2. 



(20) 



For regular Euclidean lattices the walk dimension d^ — 2 
and diffusion is normal (or Fickian). When d„ is larger 
than the fractal dimension of the underlying medium, 
df, diffusion is recurrent, otherwise, if c?w < ^f, diffusion 
is transient. The mean return time in fractals scales as 
Tu{N) ~ N 01 . The mean transit time scales as 



]\[d^/d{ 

N, 



dw > df, 
dw < df. 



(21) 



For example, for the Sierpinski gasket df = In 3/ In 2, 
dw = In5/ln2. As implied by d^ > df, diffusion is recur- 
rent, and Tij{N) - Arin5/in3^ 



Erdos - Renyi graphs 

Another interestin g ca se is that of the Erdos - Renyi 
(ER) random graph ]ll[l3. It consists of a complete 
graph Kjv where only a fraction p of the links is realized 
(a fraction 1 — p of the links is absent). At Pc = l/N 
the ER graph undergoes a percolation phase transition: 
as long as p > Pc there exists a giant component of Ng 
nodes that forms a finite fraction of the graph, Ng/N > 
as iV ^ oo. As p approaches pjf the giant component 
disappears, splintering into a multitude of smaller com- 
ponents. 

To maintain (k) constant, as — > cx), we must have 
p ~ IJ'/N, ri > 1. (Since there are N{N — l)/2 links in 
Ktv, this guarantees (k) = Essentially, we are looking 
at the giant component near the percolation threshold. 
In this case we know that Tii{Ng) 



Ng, and 



T^,iNg) 



9 ■ 



(22) 



This result is too related to fractals, as summarized 
above. It is well known that percolation in ER graphs 
is analogous to percolation in d = 6 dimensions. In the 
latter case, the incipient infinite percolation cluster (the 
analogue of the giant component) has fractal dimension 
df = 4, and diffusion on it is anomalous, with dw = 6. 

3/2 

The scaling of Ng found in ER graphs is thus consistent 
with N'^-^/d-t of percolation in d = 6 dimensions. 



Regular trees: the Cayley Tree 

As a last case, before we turn to scale-free graphs, we 
consider the Cayley tree. The Cayley tree is a regular tree 
graph, where each node has fixed degree, k. While nor- 
mally one considers the infinite tree, for our purpose we 
may imagine the tree to be finite, consisting of N nodes. 
Diffusion on the Cayley tree can be analyzed straight- 
forwardly, by using the underlying backward equation. 
One finds that both Ta and Tij scale linearly with N 
(for both old or new nodes). When N ^ oo, diffusion 
is transient. An easy way to see this is the following: 
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consider a site on the Cayley tree, that we shall take to 
be the "origin" . The k neighboring sites constitute shell 
1, and their neighbors (other than the ones on shell 1) 
are shell 2, etc. A site on shell I has k — 1 neighbors on 
shell I + 1, but only one neighbor on shell I — 1. Thus, 
diffusion from shell to shell is biased: the walker steps 
from I to I + 1 with probability {k — l)/fc, as opposed to 
probability 1/k for stepping back to l — l. This generates 
a drift away from the origin and results in transience. 



Summary and outlook 

In all the cases we have seen so far, it would seem 
that one can have fast FPTs, or recurrence, but not both 
simultaneously. Linear scaling of the FPTs with N is the 
best we have seen, but diffusion seems to be transient 
(and 'finding your way back home' improbable) whenever 
that is achieved. When diffusion is recurrent, it comes 
at the expense of a poorer scaling of FPTs with the size 
of the system: doubling the number of nodes more than 
doubles mean transit times. 

All the graphs considered above were homogeneous, at 
least in a statistical sense. That means that the distinc- 
tion between scaling for old or new nodes (upon growth) , 
mentioned in the introduction, is irrelevant. Likewise, all 
nodes in the networks we have seen were of only one type, 
either transient or recurrent. We shall now see that in 
scale-free nets one can achieve both fast FPTs and recur- 
rence simultaneously, at least for part of the graph. More 
precisely, the average FPTs for all nodes in scale-free 
graphs scales linearly with N, but increases sublinearly 
for the nodes that were already present in the net before 
growth. Additionally, the most connected nodes in the 
net (the hubs) might be recurrent, though the rest of the 
net is transient. The large inhomogeneity of scale-free 
graphs (manifest in the degree distribution) is partially 
responsible for these trends. 



A. FPT for old nodes 

Consider a node i in the 7i-th generation of the scale- 
free tree, SF±„. The FPT, for a walker in that node, 
to exit to any of its ki neighbors, is 1. Upon growth of 
the network, to generation n+1, the node will double its 
degree, from ki to 2ki. (All the new nodes are of degree 
1, see Appendix IXIl We will now show that the FPT 
from i to any of the old ki neighbors, in the newly grown 
net SF±„-|_i, is 3. It follows that the passage time from 
any node i G SF_L„ to any node j G SF_L„ triples, on 
average, upon growth to generation n + 1: 



n+lj 



3Ty(7V„), 



(23) 



Since the size of the tree triples asymptotically (as n — > 
oo), A^„+i = 3A^„ — 3, this means that the scaling effi- 
ciency exponent for old nodes is Vij = 1. 

To see the basic scaling, we refer to Fig. Let the 
FPT for going from node i to any of the old ki neighbors 
be T. Let the FPT for going from any of the new ki 
neighbors to one of the old ki neighbors be A. Then, the 
underlying backward equations are 



A=l + T, 



with solution T — 3, as stated. 
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IV. DIFFUSION IN RECURSIVE SCALE-FREE 
NETS 

Our discussion of diffusion in scale-free nets is limited 
to two examples of deterministic, recursive constructs: a 
scale- free tree (SF_L), and a scale- free graph with loops 
(SFA) O. They share the same degree distribution, 
P{k) ~ fc-^, with exponent A = 1 -f In 3/ In 2. A full 
description of these graphs is given in Appendix fXl The 
two cases symbolize two extremes: SF_L has no loops (or 
cycles) — there is only one possible path connecting any 
two nodes; but SFA is full of cycles of all sizes, and the 
number of alternate routes between two nodes increases 
as 7Vin2/in3 ^j^g graph grows recursively 20]. Ran- 
dom scale-free graphs lie somewhere between these two 
extremes. 



FIG. 1: Growth in FPTs in going from SF_L„ to SF_L„+i. 
Node i G SF^n has ki neighbors in generation n (•), and ki 
new neighbors in generation n + 1 (o). The new nodes are of 
degree one, and are connected only to i (broken lines; refer to 
Appendix IXl. 

Consider now the return FPT to node i, Tu. Let T'a be 
the FPT for returning to node i in SF±„+i. Let T'ji be 
the FPT from j — an old neighbor of i G SF_L„ — to z, 
in SF_L„+i. Similarly, let Ta be the FPT for returning to 
i in SF_L„, and Tji the FPT from the same neighbor j , to 
i, in SF_L„. For SF_L„, we have the underlying backward 
equation 
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while for SF_L„+i, 



SF±, T,v, 



1). We have 



1 



ki 

E 



The first term on the rhs indicates the possibihty that the 
walker steps from i to one of the new neighbors and back, 
which happens with probability 1/2 (half of the neighbors 
are new) and takes two time steps. We have already 
iTji, which enables us to eliminate 



shown that T'ji — 



J2 J2 T'ji^ and yields 



In other words, 



vu = l- In2/ln3 < 1. 



(24) 



The scale- free graph with loops, SFA, performs even 
better than that. In this case the PPT in going from 
node i € SPA„ to node j e SPA„ in the larger graph 
SFAn+i merely doubles: 



T.',(iV„+i) = 2T,,(iV„), 



(25) 



or I'ij = In 2/ In 3 < 1 (compare to I'ij — 1, for SF_L). 
To see this basic scaling, we refer to Pig. |21 and write 
the underlying backward equations for T; the PPT for 
exiting node i e SFA„ in the graph SPA^+i, and A; the 
PPT for reaching i from any of its new ki neighbors in 
generation n + 1: 



T 
A 



1 



. (1 + A), 
2 2^ 

\ + hl+T). 



Eq. H25|) follows from the solution, T = 2, found upon 
eliminating A. 




FIG. 2: Growth in FPTs in going from SFA„ to SFA„+i. 
Node i £ SFA„ has ki neighbors in generation n (•), and 
ki new neighbors in generation n + 1 (o). A new node j' is 
of degree two, and is connected to i and to the old node j 
(broken lines; refer to Appendix IXl. 



The equations for Tj'^ are a bit more involved than for 
the recursive tree SP_L, for we also need to consider Tjii, 
the PPT for getting from a new neighbor j' back to i (for 



Again, the relation Tji = 2Tji already found above en- 
ables one to eliminate all the unknown variables, leading 
to 



(26) 



exactly as for SP_L. Thus, for returning to the origin 
we find the same efficiency scaling exponent vu — I ~ 
In 2/ In 3 as for the recursive tree. 

We see that in the recursive scale-free nets we have 
analyzed, the PPT for old nodes scales more favorably, 
upon growth, than for all the other cases considered be- 
fore. Indeed, here i^a < 1 for the first time, and for SFA 
also Vij < 1. The question arises whether this preferred 
scaling does not come at the expense of a poorer scal- 
ing for the PPT between new nodes (that constitute the 
largest part of the net). We show next that this is not 
the case, and that rju = rjij = 1. 



B. FPT for all nodes 

Consider Tjiji , the FPT for returning to a new node 
j' e SF_L„, a neighbor of i G SP±„_i. Let Ti be the 
FPT from i to j', and let R be the FPT for returning to 
i (starting from i) without ever visiting j'. We have 



Tf,' = 1 



1 



(i? + Ti). 



The second equation here is non-standard and requires 
elaboration: it is based on the fact that starting from i 
the walker would go to j' with probability l/fc^ {ki being 
the degree of i in SP_L„), and taking one time step to do 
so. With the remaining probability the walker selects one 
of the other neighbors, but then takes an average time R 
to return to i, and it still needs time Ti to get to j' . 

To close these equations we express the PPT for re- 
turning to i as 

r..(iv„) = l(2)-H^^i?. 



Eliminating Ti and i?, this leads to 

Tj,j,{Nn)^hTu{Nn). 



(27) 
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Finally, using this equation together with the recursion 
relation of Eq. (|24|l and the fact that ki doubles in each 
generation, we find 

T,vjv(iV„) =2-3"-i ~27V„. (28) 

Curiously, the result is the same for all new nodes j', 
despite the fact that they are not equivalent (while they 
all have degree 1, they are connected to nodes of varying 
degrees) . 

We are ready to take averages over all nodes. Iterat- 
ing (|24|l . and (|27|l . we see that in SF_L„ there are 2 nodes 
with T,, = 2-3""V2"-i, 2 nodes with Tu = 2-3"^V2"-^ 
2 • 3" with 2 • 3"-i/2"-2-m^ . . . ^ and 2 • 3""^ with 
Tii = 2- 3""^ We thus obtain 

_ 23-"(9 + 2".3") 8 8 

which shows that rju — 1. Basically, the poorer scaling 
of the new nodes dominates the average. 

Next, consider Tij in SF_L„, from any node i to any 
other node j. New nodes are always of degree k ~ 1, and 
are connected to one of the old nodes (and nothing else). 
Hence, the FPT from a new node i' (a neighbor of the old 
node i) to node j is only one time step longer than Ty , 
and does not contribute to the scaling as — » oo. We 
need only worry about < , from old node i to new node 
j' (a neighbor of old node j). The underlying backward 
equation for this case is 

Tiji = Tij + Tjji . 

On the other hand, 

^j'i' = 1 + Tjji, 

which in conjunction with H28|l yields, 

= + 2 • 3"-i - 1 - Nn. (30) 

The last scaling relation follows from H23|l and Nn ~ 3" . 
In summary, 

(ry)„~7v„, (31) 

and also rjij = 1. 

For SFA we cannot perform the analogous calculations 
analytically, namely because of the way new nodes are 
connected to two old nodes, rather than one, as in SF_L, 
barring us from obtaining Tij> in an obvious way. Instead, 
we have written computer code for generating and solv- 
ing the underlying backward equations for all the nodes 
in SF A„ (see Appendix . Memory and time limita- 
tions restrict this approach to modest values of n, but it 
becomes quickly apparent that the scaling is similar to 
that of SF±. For Tu, for example, we have already seen 
that the scaling for old nodes is the same as for SF_L. 
Our numerical results confirm this, and also reveal that 
new nodes scale in the same way as (|28|) : 

Tj,,,{N„)=T ^2Nn. (32) 



The end result is that the FPTs for returning to a node 
in SFA„ are 3/2 as large as the FPTs in SF_L„, and have 
the very same distribution (Fig. (SJ . In summary, also for 
SFA, -qu = rjij = 1. 



250 
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FIG. 3: Distribution of mean return times in SFAn. Shown 
are the number of nodes having a specific mean return time 
Tii, for generations n — 1,2, ...,6. The endpoints of the 
curves represent new nodes, not present in the previous gen- 
eration, and follow the scaling of Eq. 1321 . The remainder 
of the data points scale in the more advantageous way valid 
for old nodes, Eq. I26II . The scaling of mean return times for 
SF^n is virtually the same. 



C. Recurrence 

The most connected nodes, both in SF± and SFA, are 
recurrent. We can see this from the following heuristic 
argument. Consider the thermodynamic limit of TV — > oo 
(or n —^ oo). Consider a node i in SF_L„ or SFA„, that 
has been added in in the m-th generation: in other words, 
the network has been iterated n — to times since then. 
In each of these iterations, the FPT for returning to i 
follows the scaling for old nodes, Eqs. H24|) and H26|l . so 
Tu ^ (3/2)"-™. At the same time, the FPT from i to 
other nodes scales at least as Ty ~ 3"-™, for SF_L„, or 
as Tij ~ 2"-™, for SFA„ (the lower bound is reahzed 
for nodes j that were already present in generation m as 
well). In either case Tu/Tij ^ 0, as n — > oo, suggesting 
that node i is recurrent. 

In an infinite net only a fraction zero of the nodes 
is recurrent. We can relax the definition, however, for 
finite n and deem node i "recurrent" if Tu <^ Tij, or 
(3/2)"-™ < &"-™, (6 = 3 for SF_L, and 2 for SFA). 
The fraction of "recurrent" nodes is r = 3™/3" = (1/3)^. 
Demanding Tu/T,j = (3/26)^ < 1/10, we get r = 2.6% 
and 0.015% for SF_L and SFA, respectively. 

For SF± , we can show directly that the most connected 
nodes are recurrent. The most connected node in SF_L„ 
has 2"-^ neighbors, of which 1/2 are of degree 1, (1/2)^ 
are of degree 2, . . . , (1/2)™ are of degree 2™-^, . . . , 1 is 
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of degree 2"~^, and 1 is of degree 2'^~^. Each of these 
neighbors he at the root of disconnected branches (they 
are connected to one another only through the most con- 
nected node). Using the backward equations, one can 
show rather easily that the mean return time to the most 
connected node, for a walker that steps into a neighbor 
of degree 2™, is 3™ + 1. Imagine that there is a trap, or 
sink at the origin (the most connected node). Then, half 
of the walkers — the ones that started off to neighbors 
of degree 1 — get trapped after 3° + 1 time steps; (1/2)^ 
get trapped after 3^ + 1 time steps, on average; etc. After 
time t = 3™ + 1, only (1/2)™ of the walkers survive, or 

^(t) -exp[-(ln2/ln3)i] 0, as t ^ 0, (33) 

proving that the node is recurrent. A similar argument 
holds for any node of degree 2""™, n — m < oo, n — > oo. 

Before closing this section, we analyze the FPT distri- 
bution for transit between two hubs A and B in SFA„. 
Let Fn(t) be the probability that the FPT from hub A to 
hub B in SFA„ is t. Let C{t) be the probability that the 
FPT from hub C to hub B in SFA„ is t. These satisfy 
the backward equations: 

1 1 * 

t'=Q 

1 1 * 

C{t) = -i^„_i(t) + - ^ F„_i(t - t')F,,{t'). 

t'=0 

It is easier to work with the corresponding generating 
functions, defined as in Eq. (jSJ), upon which the convolu- 
tion terms result in simple products: 

F„ix) = iF„-i(t) + ^Fn-iix)Cix), 

C{x) ^ ^h-i{x) + ^Fn-iix)F„{x). 

Considering generation n = I separately, we get the 
boundary condition Foit) — St.i, or Fo{x) = x, leading 
to Fn{x) = x/[r - (2" - l)xl and 

= ' t=l,2,... (34) 

Surprisingly, this is the same functional form as Eq. H12|l 
for the FPT distribution between nodes in the complete 
graph K^r, not only in the long time asymptotic limit, 
which is expected, but also through the early time regime. 
Note, however that the size of the net. A'', is here replaced 
by an effectively smaller size, 2" ~ ^in2/in3^ emphasiz- 
ing the advantages of scale-free nets over other architec- 
tures. 



V. DISCUSSION 

We have studied diffusion in large networks, under sev- 
eral different architectures, and have identified clear ad- 
vantages of scale- free networks over other possibilities. In 



one extreme, the complete graph, K^r, provides for the 
shortest possible path between any two nodes, but offers 
many alternative paths between the nodes as well. As a 
result, the average transit time between nodes, Tij(N), 
increases only linearly with N. The "prominence" of a 
node (the ease with which it is re-encountered by a ran- 
dom walker leaving it) is mixed: the FPT for return to 
a node scales linearly, Tii{N) ~ N , but diffusion is tran- 
sient (there is a finite probability to never find the node 
again). In the opposite extreme, a one-dimensional chain 
offers only one path between any two nodes, but now the 
distance is large (order N). This results in long tran- 
sit times, Tij{N) ~ N"^ , but increases the prominence of 
nodes: Tii{N) ^ N (as in K^f), and in addition diffusion 
is now recurrent (a random walker departing a node will 
almost surely revisit it). 

Other architectures reviewed in this article, besides 
scale-free nets, lie between these two extremes. In lat- 
tices and fractals, where the distance between nodes is 
^ TVi/c^t — Euclidean lattices), the situation is 

similar to the complete graph when diffusion is transient 
(dw < di)^ and similar to one dimension when diffusion 
is recurrent (dw > df). For Euclidean lattices dimension 
d = 2 is a borderline case separating the two scenarios. 
A smaller distance between nodes (as dimensionality in- 
creases) has the further advantage of making any directed 
mode of transport, such as diffusion with drift, faster. 

Regular trees, such as the Bethe lattice or Cayley tree, 
boast even smaller distances between nodes than Eu- 
clidean lattices or fractals, of only order InA^, while both 
Tij and Tu scale linearly with N (as good as in K^r), 
but diffusion is still transient. Overall, diffusion is very 
similar to that in the complete graph, and the modest 
logarithmic increase in the distance between nodes seems 
a small price to pay for keeping the average degree (fc) 
constant upon network growth. 

The recursive scale-free lattices analyzed in this com- 
munication outperform all of the above architectures. 
The average FPT for all nodes is as good as in Kjv; 
Tij ~ N ^ but in addition, at least for SFA, there is an 
advantage for the nodes already present in the network 
before growth; Tij ~ N"'-' , < 1. (For SF± we find 
i>ij = 1, but we suspect this is the exception rather than 
the rule, and is probably related to the complete absence 
of loops.) The prominence of nodes is, again, at least 
as good as in Kjv; Tu ^ N, but is advantageous for old 
nodes before growth; - N"", vu < 1 (both for SFA 
and SF±). Also, diffusion from the most connected nodes 
is recurrent, despite their infinite degree and the essen- 
tially infinite dimensionality of the network. Finally, the 
average distance between nodes in scale-free nets is at 
least as small as in the Bethe lattice (order In N) or bet- 
ter, as for random scale-free nets with degree exponent 
2 < A < 3 (order InlnA^). 

We have examined scale-free nets and showed that they 
hold some advantages for transport through diffusion, 
but perhaps other architectures are better still. Also, our 
study was limited to just two cases of scale-free recursive 
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nets: many other recursive models exist, but more im- 
portantly, how do random scale-free nets compare to our 
findings? These are some of the main open questions we 
will be looking at next. 
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APPENDIX A: RECURSIVE SCALE-FREE NETS 

SFA„ is constructed recursively in the following 
way 10]. The "seed" in generation n = 1, SFAi, is 
identical to K3 (a triangle). Given generation n, one can 
obtain SFA„-|_i by adding to each existing link a new 
node of degree 2, connected to the endpoint vertices of 
the link. Alternatively, SFA„+i may be obtained by join- 
ing three copies of SFA„ at the hubs (the most connected 
vertices). The two methods and the resulting graphs are 
illustrated in Fig. 0] The two different ways for generat- 
ing SFA may be exploited to study different properties of 
the graph, as dictated by convenience. For example, the 
fact that all new bonds are of degree k = 2 (method 1) 
tells us immediately that (k) = 4, while from the adjoin- 
ing of three copies (method 2) we obtain the recursion 
relation 

Ar„+i = 3iV„ - 3, 

for the order of SFA„ (the number of nodes in the graph 
of generation n). This recursion, coupled with A'^i = 3, 
yields 7V„ = (3" -I- 3)/2. Method 1 also tells us that in 
going from generation n to n -I- 1 the degree of each exist- 
ing node doubles, while method 2 says that the number 
of nodes of a given degree triples (except the hubs) . The 
degree distribution follows immediately from these two 
observations: In SFA„ there are 3"^^ nodes of degree 
2, 3"-2 of degree 2^, 3"-^ of degree 2^, . . . , 3^ of de- 
gree 2"-2, 3 of degree 2"-^ and 3 of 2". It follows that 
P(fc) - k'^, A = 1 -|-ln3/ln2. 

SF± is constructed in a similar way. The seed, SF±i, 
is identical to K2 (a single link connecting two nodes). 
To pass from generation n to n -I- 1 one either doubles 
the degree of each existing node, by connecting to the 
node new nodes of degree 1 (method 1), or instead one 
joins three copies of generation n at the hubs (method 
2). The two methods of construction and the first few 
generations are shown in Fig. [S] SF_L„ is very similar to 
SFA„: it has 2-3"-2 nodes of degree 1, 2-3"-2 of degree 
2, 2-3"-3 of degree 22, . .. , 2-3 of degree 2"-^^ 2 of degree 
2"~2 and 2 of 2"~^. The average degree is (k) = 2, and 
the degree distribution is scale-free, essentially the same 
as that of SFA; P(fc) ~ k'^, A = l + ln3/ln2. The most 
significant difference between SFA and SF_L is that the 



(a) 




n=1 n=2 n=3 




FIG. 4: The recursive scale-free graph SFAn. (a) First 
method of construction: to each link in generation n (solid 
line) add a new node (o) of degree 2, connected to the end- 
points of the old link (•). (b) Second method of construction: 
to obtain generation n+1, join three copies of generation n at 
the hubs (the nodes of highest degree), denoted by A, B, and 
C in the figure, (c) SFA„ is shown for generations n — 1,2, 3. 

latter is a tree — it has no loops and there is only one 
path connecting any two nodes. 

APPENDIX B: DYNKIN'S EQUATIONS FOR 
ADJACENCY MATRICES 

In this appendix, we present a general form of Dynkin's 
equations suitable for an arbitrary adjacency matrix. We 
take the adjacency matrix A, of a graph G with vertices 
V — {vi}fLi and edges {{vi, Vj)}, to be written as usual, 

. _ / 1 if there is an edge {vi,Vj) \ m^\ 
^''^ otherwise ) ' ^ ^ 

The Dynkin's equations describe (Ti)j, the expected first 
transit time from a vertex i to a vertex j, and the x 1 
vector Ti records first transit times for all targets j. We 
rewrite the graph Laplacian 

L = Ra - A, where Ra = rowsum(yl)/, (B2) 

where / is the identity matrix, and let 

e ^ R^^L = 1 - R^^A. (B3) 

A point-source at vertex Vi is represented by 

A,; = diag (Aj); \j ^ S^^, (B4) 

an A^ X A^ matrix of all zeros, except for a 1 in the i,i 
position. It is easy to show that the general form of the 
Dynkin's equations may be written as 

[(/- A)^ + A]T= (/- A)w, (B5) 
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n=1 
• — • 

n=3 



n=2 



n=4 



FIG. 5: The recursive scale-free graph SF^n. (a) First 
method of construction: to each node of degree k in gen- 
eration n (sohd hne and circles) add k new nodes of degree 
one, connected only to the old node (broken lines and open 
circles), (b) Second method of construction: to obtain gener- 
ation n + 1, join three copies of generation n at the hubs (the 
nodes of highest degree), denoted by A and B in the figure, 
(c) SF_L„ is shown for generations n = 1, 2, 3, 4. 



where w is an iV x 1 matrix of all 1-entries. It is ex- 
pected that this describes a nonsingular system of equa- 
tions when G has exactly one component, in which case 
the solution follows. 



[(/- A)^ + A]-i(/- A)w. 



(B6) 



Thus, with the graph presented as an adjacency matrix, 
we can easily compute first transit times, and by solving 
Eq. (|B6|I for each 8i, for each i, we can compute the 
full matrix of first transit times, (Ti)j. The expected 
first return time from a vertex vi back to itself is easily 
obtained as 



I^n: = II T, 



(B7) 



the column sum of the vector T^. In this fashion, from 
(Ti)j we can compute the full vector of first return times. 



APPENDIX C: ADJACENCY MATRICES OF 
SELF-SIMILAR GRAPHS 

In the general random graph case, an adjacency ma- 
trix can directly be computed by Eq. ljBl|l . For the 



self-similar graphs discussed in this paper, the adjacency 
matrices can be generated in a neat recursive manner, 
through the Kronecker-product, ®. 

Consider the sequence of triangular scale-free graphs, 
SFA„, shown in Fig. 0| Notice that SFAi has the adja- 
cency matrix, 




(CI) 



Generally, for recursive networks of the type considered 
in this paper, there is always a first stage: we denote 
the corresponding adjacency matrix by A\. Likewise, we 
denote the adjacency matrix of the recursive graph in 
generation n by A^- These can be directly computed 
by the following algebraic recursion. Given A\ , let 

An+i = Rn+i ■ [M ® (P„ • A,, ■ P/J] • P*,+i. (C2) 

The particular form and size of the matrix M dictates 
how identical copies of An will be assembled together. 
For example, in the case of SFA„ we have 



(C3) 



the 3x3 identify matrix. The Rn are non-square pro- 
jection matrices. For example, in the case of SFA„ the 
{n — 3) X rt matrix i?„ is the "almost diagonal" matrix 
written in terms of projections of the n x n identity ma- 
trix In, 



Rn — 



/„(l,:) + /„(n,:) 
/„(2: (n/3-1),:) 
/„(n/3,:) + /„((n/3+l),:) 
/„((n/3 + 2) : (2n/3-l),:) 
J„(2n/3,:) + /„((2n/3-)-l),:) 
V /„((2n/3 + 2) : (n-1),:) / 



(C4) 



This pastes the different copies of generation n together, 
by merging at "pivot" nodes. Finally, the P„ are n x n 
permutation matrices which serve to re-order rows and 
columns of An , to ensure that the right pivot nodes (the 
hubs, in the case of SFA„) are picked up for merging 
next . 

The choice of M, and P„, define the construction 
through the algebra of the Kronecker product for a very 
large class of recursive graph families. Furthermore, one 
could mix-and-match the P„, M, and P„ to be different 
matrices at each stage, to produce an even larger class of 
graphs. 

In this manner it is straightforward to produce An on a 
computer for any stage n, and together with the general 
form of the Dynkin's equations discussed in Appendix IbI 
one can easily compute T and the average FPTs. 
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